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TITLE OF THE INVENTION 
IMAGE PROCESSING APPARATUS, IMAGE FORMING APPARATUS, 
AND IMAGE PROCESSING METHOD DEPENDING ON THE TYPE OF 
ORIGINAL IMAGE 
5 CROSS-REFERENCE TO RELATED APPLICATIONS 

This application is based upon and claims the 
benefit of priority from the prior Japanese Patent 
Applications No. 11-094981, filed April 1, 1999; and 
No. 11-094982, filed April 1, 1999, the entire contents 
10 of which are incorporated herein by reference. 

BACKGROUND OF THE INVENTION 
The present invention relates to an image 
processing apparatus, an image forming apparatus, and 
an image processing method for performing a specified 
15 conversion process when filing or copying documents or 

images . 

In an image forming apparatus , color or 
monochromatic images of color or monochromatic copier 
or the like are read, and copy images are formed, and 

20 when copying, a high image quality is required 

regardless of the type of the original image. 

The image quality of the image information 
necessary to realize a high copy image quality differs 
significantly depending on the type of the original to 

25 be copied. For example, in the case of a photographic 

original, reproduction of color and gradation is 
important, and the image quality true to the original 
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is demanded. On the other hand, in the case of a 
document original mainly containing characters, the 
clarity is demanded rather than the color of characters, 
and an easy-to-read image quality is required. 
5 In a conventional copier, however, original modes 

optimizing the quality of copy image in various 
originals are available (character/photo mode, 
character mode, photo mode, map mode and the like), and 
the user selects a proper original mode depending on 

10 the type of the original to be copied, and copies the 

image. Herein, the character mode and photo mode are 
exclusive modes for character only and photo only, and 
in the case of a mixed original of character and photo, 
the character /photo mode is used. For example, this 

15 sort of the image forming apparatus is disclosed in US 

patent application No. 08/682,007, in which the image 
processing apparatus can extinguish character area, a 
graph area, page area, and photo area from the image 
data, and it processes the image data corresponding to 

20 the extinguished areas. 

However, discrimination of regions conducted by 
the apparatus is not always perfect in precision of 
discrimination, and wrong discrimination may occur, 
and therefore depending on the condition of image 

25 processing, the image quality may deteriorate extremely 

in a falsely discriminated region, or when regions of 
same type are discriminated differently, the image 



quality differs in the boundary of the two regions. To 
decrease problems due to such wrong discrimination, the 
difference in processing is reduced between the image 
types to be discriminated, and in the case of wrong 
discrimination, deterioration of image quality due to 
wrong discrimination may be made less obvious, but when 
the difference in processing between plural image types 
to be discriminated is reduced, the degree of 
improvement of image quality when discriminated 
correctly is smaller, and therefore the image quality 
when the original of characters only is, for example, 
formed in character /photo mode is inferior to the case 
when formed in character mode if discriminated 
correctly. Hence, more accurate discriminating 
capability of image types of original is demanded, and 
the image processing apparatus capable of processing 
the image accordingly is required. 

BRIEF SUMMARY OF THE INVENTION 

It is an object of the present invention to 
present an image processing apparatus, an image forming 
apparatus, and an image processing method capable of 
discriminating the types of original images correctly, 
and processing the images most efficiently suited to 
the type of the original image . 

The present invention provides an image processing 
apparatus comprising input means for inputting image 
data of an original image; discriminating means for 
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extracting a predetermined region by using a feature of 
pixel of the image data input from the input means, and 
for discriminating the attribute of the region; 
determining means for determining the type of the image 
5 data on the basis of the distribution of the regions 

attribute of which discriminated by the discriminating 
means; and processing means for processing the image 
data as specified depending on the type of the image 
data determined by the determining means . 

10 With such constitution, the present invention 

discriminates attributes of image types in plural 
regions, and determines the image type of the entire 
document image on the basis of the distribution of 
the discriminated attributes. As a result, the image 

15 types can be deteiiroined more accurately, and correct 

processing is done securely depending on the image type 
of the document, so that an image processing apparatus 
capable of obtaining image data with high image quality 
can be presented. 

20 The present invention further provides an image 

forming apparatus comprising input means for inputting 
image data of an original image; discriminating means 
for extracting a predetermined region by using a 
feature of pixel of the image data input from the input 

25 means, and for discriminating the attribute of the 

region; determining means for determining the type of 
the image data on the basis of the distribution of the 



regions attribute of which discriminated by the 
discriminating means; processing means for processing 
the image data as specified depending on the type of 
the image data deteonnined by the determining means; and 
5 image forming means for forming an image on a recording 

medium on the basis of the image data processed as 
specified by the processing means. 

In the present invention, as described above, in 
the image processing apparatus and image forming 

10 apparatus, optimum image processing is done depending 

on the type of the document image by the same principle 
of operation, so that image data and image are foirmed 
at high image quality. 

Additional objects and advantages of the invention 

15 will be set forth in the description which follows, and 

in part will be obvious from the description, or may be 
learned by practice of the invention. The objects and 
advantages of the invention may be realized and 
obtained by means of the instrumentalities and 

20 combinations particularly pointed out hereinafter. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 
The accompanying drawings , which are incorporated 
in and constitute a part of the specification, 
illustrate presently preferred embodiments of the 

25 invention, and together with the general description 

given above and the detailed description of the 
preferred embodiments given below, serve to explain the 
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principles of the invention. 

FIG. 1 is a block diagram showing a schematic 
constitution of an image processing apparatus in a 
first embodiment of the present invention; 
5 FIG. 2 is a flowchart for explaining an example of 

image processing in the image processing apparatus in 
the first embodiment; 

FIG. 3 is a flowchart for explaining the image 
type determining process in the image processing 
10 apparatus in the first embodiment; 

FIG. 4 is a flowchart for explaining the image 
type determining process in the image processing 
apparatus in the first embodiment; 

FIG. 5 is a flowchart for explaining the data 
15 converting process in the image processing apparatus in 

the first embodiment; 

FIG. 6 is a block diagram showing a schematic 
constitution of an image processing apparatus in a 
second embodiment of the present invention; 
20 FIG. 7 is a flowchart for explaining an example of 

image processing in the image processing apparatus in 
the second embodiment; 

FIG. 8 is a flowchart for explaining the image 
correcting process in the image processing apparatus in 
25 the second embodiment; 

FIG. 9 is a block diagram showing a schematic 
constitution of an image processing apparatus in a 
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third embodiment of the present invention; 

FIG. 10 is a flowchart for explaining an example 
. of image processing in the image processing apparatus 
in the third embodiment; 
5 FIG. 11 is a flowchart for explaining the image 

type changing process in the image processing apparatus 
in the third embodiment; 

FIG. 12 is a block diagram showing a schematic 
constitution of an image processing apparatus in a 
10 fourth embodiment of the present invention; 

FIG. 13 is a flowchart for explaining an example 
of image processing in the image processing apparatus 
in the fourth embodiment; 

FIG. 14 is a flowchart for explaining the 
15 application starting process in the image processing 

apparatus in the fourth embodiment; 

FIG. 15 is a block diagram showing a schematic 
constitution of an image forming apparatus in a fifth 
embodiment of the present invention; 
20 FIG. 16 is a diagram showing an example of 

constitution of image processing means; 

FIG. 17 is a diagram showing an example of circuit 
constitution of color converting means; 

FIG. 18 is a diagram showing an exaimple of circuit 
25 constitution of space filter means; 

FIG. 19 is a diagram showing a filter constitu- 
tion; 



FIG. 20 is a diagram showing a specific example of 
circuit constitution of space filter me^s ; 

FIG. 21 is a diagram showing an example of circuit 
constitution of black printing means; 
5 FIG. 22 is a diagram showing an example of 

constitution of y -correcting means; 

FIG. 2 3 is a diagram for explaining setting of 
density converting curve; 

FIG. 24 is a diagram showing constitution of 
10 binary processing by error diffusion method; 

FIGS. 25A, 25B are diagrams for explaining 
gradation processing means; 

FIG. 2 6 is a diagram showing an example of 
constitution of page information discriminating means; 
15 FIG. 27 is a diagram showing an example of 

constitution of image forming apparatus when using page 
discriminating information and rectangle discriminating 
information according to a sixth embodiment; 

FIGS. 28A to 28D are diagrams for explaining page 
20 discriminating information and original mode; 

FIG. 29 is a diagram showing an example of 
constitution of image processing means for executing 
image processing by discriminating in pixel unit 
according to a seventh embodiment; 
25 FIG. 30 is a diagreim showing an example of circuit 

constitution of pixel unit discriminating means; 

FIG. 31 is a diagram for explaining a window of 



- 9 



4X4; 

FIG. 32 is a diagram showing an example of 
constitution of image forming apparatus when using page 
discriminating information by pixel unit discriminating 
5 means according to an eighth embodiment; 

FIG. 33 is a diagram showing an example of 
constitution of image forming apparatus when becoming 
impossible to discriminate according to a tenth 
embodiment ; 

10 FIG. 34 is a diagram showing an example of 

constitution of image forming apparatus when becoming 
impossible to discriminate according to an eleventh 
embodiment; 

FIG. 35 is a diagram showing other example of 
15 constitution of image forming apparatus when using page 

discriminating information according to a twelfth 
embodiment; and 

FIG. 36 is a diagram showing the relation of 
original mode expressing the operation mode, page 
20 discriminating information, and processing condition of 

each image processing block. 

DETAILED DESCRIPTION OF THE INVENTION 
Referring now to the drawings, embodiments of the 
present invention are described in detail below. 
25 <First Embodiment > 

A first embodiment of the present invention is 
described below. FIG. 1 shows a schematic constitution 
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of an image processing apparatus according to the first 
embodiment of the present invention. In FIG. 1, the 
image processing apparatus comprises an image input 
unit 101, a region discriminating unit 102, an image 
5 type determining unit 103, a data converting unit 104, 

and an image forming unit 105. 

The image input unit 101 is a device for inputting 
image data, and by an image input device such as image 
scanner or a device for reading a document and 

10 converting into image data, this is a device for 

incorporating what is depicted from document or other 
paper . The image input unit of the present invention 
may be composed of a reading device such as image 
scanner, or a device for incorporating image already 

15 stored in a filing device or the like as image data. 

The region discriminating unit 102 is to 
discriminate a pixel having character as a region from 
the image data input from the image input unit 101. 
First, the image data input in the image input unit 101 

20 is separated into a plurality of binary image data 

depending on the density difference of peripheral 
pixels, chroma and other state, and divided and 
extracted into each region where the character or 
pattern is coupled physically or logically from the 

25 image, and feature quantities such as the position of 

the reason, its size, shape, structure and density 
distribution are measured, and the attribute is 
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determined as the document element. Attribute types of 
document elements include character, photograph, 
drawing, table, and dots. 

Some specific techniques for separating into a 
5 plurality of binary image data can be used. In this 

case, as the output of the image separating unit 102, 
seven pieces of binary separate image data are created, 
that is, character image, half tone image, background 
image, dot image, color image, gray image, and black 

10 image. These techniques are already known. 

Some specific techniques for extracting and for 
discriminating documents elements may be used. 

In the region discriminating region 102, not only 
from single image data, feature quantities of a 

15 plurality of image data are integrated according to a 

rule, and the region attribute of the input image data 
is determined. For example, from both character image 
and half tone image, when regions are extracted at the 
same position, the type of the region and the size of 

20 the region are determined. For example, when a photo 

region is present on the character image, and a half 
tone image and a half tone pixel are present at a same 
position, it is determined as a continuous gradation 
photo region. Some specific techniques for determining 

25 the region attribute from plural pieces of image data 

are already known, and may be used. 

The image type determining unit 103, of which 
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detail is described below, determines feature 
quantities such as presence or absence of key regions 
such as dot and photograph, and complicatedness as 
document structure depending on the degree of 
5 overlapping of rectangular regions , from the results 

discriminated in each region such as character, 
photograph, drawing, table and dot in the region 
discriminating unit 102, and determines what kind of 
docviment is the input image data. 
10 Herein, types of image data include, for example: 

1) The background is uniform, and only characters 
drawings and tables are present. 

2) The background has dots, and only characters, 
drawings and tables are present. 

15 3) Only dot photograph is present. 

4 ) Only continuous photograph is present . 

5) At least one of characters, drawings and table 
coexists with dot photograph, and also it is possible 
to extract a rectangular region; or at least one of 

20 characters, drawings and tables coexists with 

continuous photograph, and also it is possible to 
extract a rectangular region. 

6 ) At least one of characters , drawings and table 
coexists with dot photograph, and it is impossible to 

25 extract a rectangular region; or at least one of 

characters, drawings and tables coexists with 
continuous photograph, and it is impossible to extract 



13 - 



a rectangular region. 

The data converting unit 104, of which detail is 
described later, changes the type of input image data 
according to the type of the document corresponding to 
5 the type of image determined in the image type 

determining unit 103. Change of type of image data may 
be, for example, change of resolution, compression rate 
or number of colors. Also, the region information of 
attribute may be converted into an image . 
10 The image forming unit 105 is to form an image of 

image data converted by the data converting unit 104 on 
a recording medium such as a sheet. At this time, 
further, it may be also saved in a storage as image 
file. 

15 In such constitution, processing of the image 

processing apparatus of the present invention is 
described below. 

FIG. 2 is a flowchart showing an example of 
document processing procedure in the image processing 

20 apparatus shown in FIG. 1. Referring to this flowchart 

flow of processing of the image processing apparatus of 
the present invention is described below. 

First, a document image is taken into the image 
input unit 101 (step ST201) . That is, using an image 

25 input device such as scanner, the image is read from 

the documents, or a filing system or the like 
containing image file data is converted into image data 



by the image input unit 101. 

In the region discriminating region 102, reading 
out one line or several lines from the image input 
device, data is divided into a plurality of binary 
image data depending on the state of each pixel such as 
density difference of peripheral pixel or chroma, and 
divided and extracted in each region in which the 
character or pattern is coupled physically or logically, 
and the type of region and degree of importance are 
discriminated by measuring the feature quantities such 
as the position of the region, its size, shape, 
structure and density distribution, thereby extracting 
character, photograph, drawing, table and dot regions 
(step ST202). This operation is repeated until 
processing of all pixels of the input image is over 
(step ST203) . 

After all pixel attributes are determined, in the 
image type determining unit 103, from the results 
discriminated in each region of character, photograph, 
drawing, table and dot, by determining the feature 
quantities such as presence or absence of key regions 
such as dot and photograph, and compile a tedness as 
document structure from the degree of overlapping of 
rectangular regions, it is determined what kind of 
document is the input image data (step ST204). The 
detail of specific processing in the image type 
detemining unit 103 is described later by referring to 
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FIG. 3. 

After determining the type of the document of the 
input image data, in the data converting unit 104, the 
format of image data is converted depending on the 
5 document type according to the type of the image data 

(step ST205). The detail of specific processing in the 
data converting unit 104 is described later by 
referring to FIG. 5. 

Finally, in the image forming unit 105, the image 
10 converted in the image data format is formed on a 

recording medium (step ST206). 

This is a rough processing operation of the image 
forming apparatus. The processing of individual 
elements is described specifically below. 
15 FIG. 3 is a flowchart showing the detail of image 

type determining process as an example in the image 
type determining unit 103 of the image processing 
apparatus, and this is a flowchart of the process 
corresponding to step ST204 shown in FIG. 2. The image 
2 0 type determining process is a process of what kind of 

document is the input image data, by making use of the 
region discriminating result of each pixel. 

In this process, first, an example of document 
type classification determined by the type of image 
25 data is described below. 

A uniform background original document is one not 
having photo region and dot region. It is therefore an 
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original of character region only or in a blank state 
in which nothing is written. 

A dot background original is one having a dot 
region, and having a character region contained in the 
5 dot region. 

A dot photo original is one having a dot region, 
and having photo region in the dot region but not 
having character region. 

A continuous gradation photo original is one not 
10 having dot region and character region, and having 

photo region only. 

A rectangular discrimination original does not 
belong to any one of uniform background original, dot 
background original, dot photo original, or continuous 
15 gradation photo original, and not having complicated 

layout structure, which can be divided into each region 
of character, dot, photograph, drawing, table, etc. 

One having complicated layout structure, which 
cannot be divided into each region of character, 
20 dot, photograph, drawing, table and the like, is 

discriminated from other originals as an 
indiscriminative original. 

In FIG. 3, pixel attribute data 151 is the 
attribute of each pixel of input image data determined 
25 by using the type and importance of the region of the 

plural image data discriminated in the region 
discriminating unit 102, and is expressed as the region 



17 



of each document element . 

First, reading data from the pixel attribute data 
151, it is checked if dot region is present or not 
(step ST301) . If a dot region is present, then it is 
5 checked if photo region is present or not (step ST302). 

If a photo region is present, then it is checked if 
character region is present or not (step ST303) . If a 
character region is present, it is a rectangle 
discrimination candidate original 152. The rectangle 

10 discrimination candidate original 152 is classified 

into rectangular discriminative original or 
indiscriminative original, consequently by the process 
for verification of complicatedness of the layout 
structure. A detailed description of this process is 

15 given later by referring to FIG. 4. 

If there is no character region at step ST303, it 
is a dot photo original 153. 

If there is no photo region at step ST302, it is 
checked if character region is present in the dot 

2 0 region or not (step ST304) . If there is a character 

region in the dot region, it is a dot background 
original 154. If there is no character region in the 
dot region, it is further checked if there is character 
region outside the dot region (step ST305). If there 

25 is no character region outside the dot region, it is a 

dot photo original 153. If there is a character region 
outside the dot region, it is a rectangle 
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discrimination candidate original 152. 

If there is no dot region at step ST301, it is 
checked if photo region is present or not (step ST306). 
If there is no photo region, it is a uniform background 
original 156. If there is a photo region, it is 
further checked if character region is present or not 
(step ST307). If there is no character region, it is a 
continuous gradation photo original 155. If there is a 
character region, it is a rectangle discrimination 
candidate original 152 . 

By this process, the input image data is 
determined in any one of rectangle discrimination 
candidate original 152, dot photo original 153, dot 
background original 154, continuous gradation photo 
original 155, and uniform background original 156. 

FIG. 4 is a flowchart showing the detail of image 
type determining process as an example in the image 
type determining unit 103 of the image processing 
apparatus of the present invention, which is a 
flowchart of process corresponding to the rectangle 
discrimination candidate original 152 shown in FIG. 3. 

When determined to be a rectangle discrimination 
candidate original 152, the complicatedness of the 
layout structure is verified, and it is classified into 
rectangle discriminative original or indiscriminative 
original, and at this time, as an index of measuring 
the complicatedness of the layout structure, the degree 
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of overlapping of rectangular regions may be measured. 
The degree of overlapping of rectangles may be directly 
verified, but when the number of rectangular regions is 
increased, it is estimated that the number of times of 
5 comparison increases dramatically. Accordingly, by 

voting the rectangle size in the two-dimensional voting 
space being prepared, the degree of overlapping may be 
estimated from the state of the voting space (step 
ST401) . 

10 This voting space is for measuring the degree of 

overlapping of rectangular regions, and its resolution 
may be lower than the resolution of the original image. 
Voting is done by adding the feature such as rectangle 
size of the region to the position where the coordinate 

15 position of the rectangular region is converted into 

the coordinate position of the voting space. An 
example of rectangle size is width, height or area of 
the rectangle. Besides, the voting value may be 
weighted according to the attribute of the rectangular 

20 region, that is, the character, photograph, drawing, 

table, dot or other attribute. For example, the 
attribute having a great effect on the layout structure, 
such as photograph, drawing and table is provided with 
a large weight, and the character has a small weight, 

2 5 so that the voting value is large in the overlapped 

region of photograph or drawing and table. Considering 
the complicatedness of the layout structure. 
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overlapping of photograph or drawing and table is 
classified into a complicate category. Therefore, in 
this case, it is easy to regard as a complicated 
structure. For faster processing, moreover, it is also 
5 possible to limit the rectangular region to be voted. 

For example, a small character region does not always 
have a large effect in determination of layout 
structure. In such a case, by limiting the rectangle 
size to be voted, the number of times of voting is 

10 saved, and a faster processing is expected. However, 

if the character region existing in image data is 
composed of small character regions alone, it cannot be 
always ignored. In such a case, it is possible to 
adjust the limitation depending on the state of the 

15 pixel attribute data which is the output of the region 

discriminating unit 102. 

When voting of rectangle size in all voting spaces 
is over, the feature quantities in the voting spaces 
are measured (step ST402). As the feature quantity, 

20 for example, the statistic value of maximum or variance 

may be used, or, regarding the voting space to be a 
multi-value image, the region may be extracted after 
binary processing. In the former case, it is possible 
to determine by comparison between the calculated value 

25 and the preset threshold, and in the latter case it is 

possible to determine by measuring the graphic feature 
of the extracted region. At step ST402, the former 



example is employed. In this case, if the maximum 
(max) or variance (var) is smaller than the threshold 
(a) or (b), the layout structure is regarded not 
complicated, and is determined to be a rectangle 
discriminative original 157, and if larger, to the 
contrary, the layout structure is regarded complicated, 
and is determined to be an indiscriminative original 
158 (step ST403) . 

This is the detailed description of the image type 
determining unit 103, and, as a result, the input image 
data is determined as any one of dot photo original 153 
dot background original 154, continuous gradation 
photo original 155, uniform background original 156, 
rectangle discriminative original 157, and 
indiscriminative original 158 . 

FIG. 5 is a flowchart showing the detail of data 
conversion process as an example in the data converting 
unit 104 of the image processing apparatus, which is a 
flowchart of the process corresponding to step ST205 in 
FIG. 2. The data conversion process is a process for 
changing the format of the input image data by making 
use of the determining result of image type. 

The image type information 161 is the output of 
the image type determining unit 103, and expresses the 
type of input image data, which is one of dot photo 
original 153, dot background original 154, continuous 
gradation photo original 155, uniform background 
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original 156, rectangle discriminative original 157, 
and indiscriminative original 158. 

First, it is checked if the image type information 
161 is an indiscriminative original or not (step ST501) 
5 If not indiscriminative original, next it is checked if 

rectangle discriminative original or not (step ST502). 
In the case of rectangle discriminative original, 
making use of the information of the pixel attribute 
obtained in the region discriminating unit 102, the 

10 data conversion process is executed on the input image 

data in every rectangular region (step ST503) . 

Data conversion process is, for example, change of 
resolution, compression rate, or number of colors. A 
rule of data conversion process may be preset in every 

15 pixel attribute, and the data conversion process may be 

done according to this rule. For example, in the case 
of dot photo region or continuous photo region, if the 
resolution is lowered or the compression rate is raised 
image deterioration may not be obvious, and the 

20 quantity of information can be curtailed. Or if only 

black characters are present in the character region, 
the multi-value data may be converted into two-value 
data, so that the quantity of information can be 
curtailed. In this way, by presetting a specific rule 

25 of data conversion process in every pixel attribute, it 

is possible to convert into efficient image data. 

As a result of data conversion process, converted 
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image data 162 is output. 

If it is not rectangle discriminative original at 
step ST502, the entire image is uniformly processed by 
data conversion (step ST504). As uniform data 
5 conversion process, for example, in the case the image 

type information 161 is dot photo original or 
continuous gradation photo, if the resolution is 
lowered or the compression rate is raised, image 
deterioration may not be obvious , so that the quantity 

10 of information may be curtailed. Or when the image 

type information 161 is uniform background original and 
there are only black characters , the multi-value data 
may be converted into two-value data, so that the 
quantity of information can be similarly curtailed. In 

15 this way, similarly to at step ST503, by presetting a 

specific rule of data conversion process in every image 
type, it is possible to convert into efficient image 
data. In this case, unlike step ST503, without 
processing data conversion in every rectangular region, 

20 since the same process is applied on the entire image, 

the processing speed is higher. 

As a result of data conversion process, similarly 
to at step ST503, converted image data 162 is output. 
In the case of indiscriminative original at step 

25 ST501, without processing data conversion by using the 

information of the pixel attribute obtained in the 
region discriminating unit 102 , the input image data is 
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directly output as corrected image data (step ST505). 
Meanwhile, the data conversion process (step ST503 and 
step ST504) is not limited to processing of input image 
data such as change of resolution, compression rate and 
5 number of color, but also includes, as mentioned above, 

the process of converting the attribute region 
information into image data. 

Thus, since the data conversion is processed 
according to the determined type of the image data by 

10 determining the type of the input image data from the 

result of discriminating the region, it is possible 
to convert into efficient image data having less 
deterioration of image quality. 
< Second Embodiment > 

15 A second embodiment of the present invention is 

described next. The second embodiment is shown in 
FIG. 6, and relates to an image processing apparatus 
for correcting image data by appropriate density 
conversion or filter processing, according to the 

20 result of discriminating the type of image. 

FIG. 6 schematically shows the constitution of the 
image processing apparatus of the second embodiment. 
In FIG. 6, the image processing apparatus comprises an 
image input unit 101, a region discriminating unit 102, 

25 an image type determining unit 103, an image correcting 

unit 106, and an image forming unit 105, in which the 
image correcting unit 106 corresponds to the data 
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converting unit 104 in the first embodiment shown 
in FIG. 1. The image input unit 102, region 
discriminating unit 102, image type determining unit 
103, and image forming unit 105 are already explained, 
5 and the image correcting unit 106 is described below. 

FIG. 7 is a flowchart showing an example of 
document processing procedure in the image processing 
apparatus shown in FIG. 6. Of the flowchart of the 
constitution in FIG. 1 shown in FIG. 2, herein, the 
10 data conversion process (step ST205) is changed to 

image correction process (step ST207). 

After determining the document type of the image 
data input in the image type determining unit 103, in 
the image correcting unit 106, the image data is 
15 corrected by appropriate density conversion or filter 

processing according to the document type corresponding 
to the type of the image data (step ST207). 

FIG. 8 is a flowchart showing the detail of image 
correction process as an example in the image 
2 0 correcting unit 106, which is a flowchart of the 

process corresponding to step ST207 shown in FIG. 7. 

The image type information 161 is the output of 
the image type determining unit 10 3, and expresses the 
type of input image data, which is one of dot photo 
25 original 153, dot background original 154, continuous 

gradation photo original 155, uniform background 
original 156, rectangle discriminative original 157, 
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and indiscriminative original 158. 

First, it is checked if the image type information 
161 is an indiscriminative original or not (step ST601) . 
If not indiscriminative original, next it is checked if 
5 rectangle discriminative original or not (step ST6 02). 

In the case of rectangle discriminative original, 
making use of the information of the pixel attribute 
obtained in the region discriminating unit 102, the 
image correction process is executed on the input image 

10 data in every rectangular region (step ST603) . 

Image correction process is, for example, density 
conversion process or filtering process. A rule of 
image correction process may be preset in every pixel 
attribute, and the image correction process may be done 

15 according to this rule. For example, in the case of 

character region, high pass filter may be processed so 
that the characters may be more clear, or in the case 
of dot photo region, low pass filter may be processed 
to obtain a smooth image without moire. As a result, 

20 being corrected into image data of high quality, it may 

be output as corrected image data 163. In this way, by 
presetting a specific rule of image correction process 
in every pixel attribute, it is possible to correct 
into image data of high quality. 

25 If it is not rectangle discriminative original at 

Step ST602, the entire image is uniformly processed by 
image correction (step ST604) . As uniform image 



correction process, for example , in the case of uniform 
background original, the entire image may be processed 
by high pass filter so that the characters may be clear, 
or in the case of dot photo region, the entire image 
may be processed by low pass filter to obtain a smooth 
image without moire. In this way, similarly to at 
step ST603, by presetting a specific rule of image 
correction process in every image type, it is possible 
to correct into image data of high quality. In this 
case, unlike step ST603, without processing image 
correction in every rectangular region, since the same 
process is applied on the entire image, the processing 
speed is higher. As a result of image correction 
process, similarly to at step ST603, corrected image 
data 16 3 is output. 

In the case of indiscriminative original at step 
ST601, without processing image correction by using the 
information of the pixel attribute obtained in the 
region discriminating unit 102, the input image data is 
directly output as corrected image data (step ST605). 

Thus, since the image correction is processed 
according to the determined type of the image data by 
determining the type of the input image data from the 
result of discriminating the region, it is possible to 
obtain image data of high quality. 

< Third Embodiment > 

A third embodiment of the present invention is 



- 28 - 



described below. The third embodiment is shown in 
FIG. S, and relates to an image processing apparatus 
for selecting the image format to be stored, converting 
into this format, and storing, according to the result 
5 of discriminating the type of image when filing the 

image . 

FIG. 9 schematically shows the constitution of the 
image processing apparatus of the third embodiment. In 
FIG. 9, the image processing apparatus comprises an 

10 image input unit 101, a region discriminating unit 102, 

an image type determining unit 103, an image format 
changing unit 107, and an image forming unit 105, in 
which the image format changing unit 107 corresponds to 
the data converting unit 104 and an image memory unit 

15 108 corresponds to the image forming unit 105 in the 

first embodiment shown in FIG. 1. The image input unit 
102, region discriminating unit 101, and image type 
determining unit 103 are already explained and are 
omitted herein. An image memory unit 108 is the output 

2 0 destination after conversion of image format, and is 

substantially regarded to operate same as the image 
forming unit 105. Therefore, the image format changing 
unit 107 is described below. 

FIG. 10 is a flowchart showing an example of 

25 document processing procedure in the image processing 

apparatus shown in FIG. 9. Of the flowchart of the 
constitution in FIG. 1 shown in FIG. 2, herein, the 
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data conversion process (step ST205) is changed to 
image format changing process (step ST208). 

After determining the document type of the image 
data input in the image type determining unit 103, in 
5 the image format changing unit 10 7, the image format 

suited to be stored in the image memory unit 108 is 
selected according to the document type corresponding 
to the type of the image data, and it is converted to 
this format (step ST208). 

10 FIG. 11 is a flowchart showing the detail of image 

format conversion process as an example in the image 
format changing unit 107, which is a flowchart of the 
process corresponding to step ST208 shown in FIG. 10. 
The image type information 161 is the output of 

15 the image type determining unit 103, and expresses the 

type of input image data, which is one of dot photo 
original 153, dot background original 154, continuous 
gradation photo original 155, uniform background 
original 156, rectangle discriminative original 157, 

20 and indiscriminative original 158. 

First, it is checked if the image type information 
161 is an indiscriminative original or not (step ST701) . 
If not indiscriminative original, next it is checked if 
rectangle discriminative original or not (step ST702). 

25 In the case of rectangle discriminative original, 

making use of the information of the pixel attribute 
obtained in the region discriminating unit 102, the 
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image format conversion process is executed on the 
input image data in every rectangular region (step 
ST703) . 

The image format includes, for example, JPEG 
format and TIFF (G4) format. A rule of image format 
conversion process may be preset in every pixel 
attribute, and the image format conversion process may 
be done according to this rule. For example, in the 
case of character region, the quantity of data can be 
curtailed by converting into the TIFF (G4) format, and 
it is changed into efficient image data. Or, in the 
case of dot photo region or continuous gradation photo 
region, by converting into the JPEG format, the 
quantity of data can be compressed while suppressing 
deterioration of image quality, and in this case, too, 
it is changed into efficient image data. As a result, 
it can be stored as format converted image data 164. 
In this case, from one image data, plural formats of 
image data are generated. When storing, therefore, 
they may be stored individually. At this time, the 
structure of the original image data and the format 
converted image data name generated therefrom may be 
saved as reference file, and when restoring, by 
referring to this reference file, the original image 
data may be reconstructed from the format converted 
image data 164. In this way, by presetting a specific 
rule of image format conversion process in every pixel 
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attribute, it is possible to convert into image data 
format of high efficiency by curtailing the quantity of 
data. 

If it is not rectangle discriminative original at 
5 step ST7 02, the entire image is uniformly processed by 

image format conversion (step ST704). As uniform image 
format conversion process, for example, in the case of 
uniform background original, which does not include 
photograph, by converting into TIFF (G4) format, the 

10 quantity of data can be curtailed, or in the case of 

dot photo original or continuous gradation photo 
original, by converting into the JPEG format, the 
quantity of data can be compressed while suppressing 
deterioration of image quality. In this way, similarly 

15 to at step ST7 03, by presetting a specific rule of 

image format conversion process in every image type, it 
is possible to convert into image data format of high 
efficiency reduced in the quantity of data. In this 
case, unlike step ST703, without processing image 

2 0 format conversion in every rectangular region, since 

the same process is applied on the entire image, the 
processing speed of image format conversion is higher, 
and plural image formats are not generated, and 
therefore the reference file is not needed, and the 

25 original image data can e restored at high speed from 

the stored format converted image data. As a result 
of image format conversion process, similarly to at 
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step ST703, it can be stored as format converted image 
data 164. 

In the case of indiscriminative original at step 
ST701, without processing image format conversion by 
5 using the information of the pixel attribute obtained 

in the region discriminating unit 102, the input image 
data is directly output as format converted image data 
(step ST705) . 

Thus since the image format conversion is 
10 processed according to the determined type of the image 

data by determining the type of the input image data 
from the result of discriminating the region, it is 
possible to change into image data of high efficiency, 
and the quantity of information when storing can be 
15 curtailed. 

< Fourth Embodiment > 

A fourth embodiment of the present invention is 
described below. The fourth embodiment is shown in 
FIG- 12, and relates to an image processing apparatus 

20 for selecting the application to be started, 

determining the starting parameter, and starting the 
application, according to the result of determining the 
type of the image, 

FIG. 12 schematically shows the constitution of 

25 the image processing apparatus of the fourth embodiment. 

In FIG. 12, the image processing apparatus comprises an 
image input unit 101, a region discriminating unit 102, 
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an image type determining unit 103, an application 
starting unit 109, and an application processing result 
forming unit 110, in which the application starting 
unit 109 corresponds to the data converting unit 104 
5 and the application processing result forming unit 110 

corresponds to the image forming unit 105 in the first 
embodiment shown in FIG. 1. The image input unit 101, 
region discriminating unit 102, and image type 
determining unit 103 are already explained and are 

10 omitted herein. The application processing result 

forming unit 110 is the output destination of the 
result of processing after starting the application, 
and is substantially regarded to operate same as the 
image forming unit 105. Therefore, the application 

15 starting unit 109 is described below. 

FIG. 13 is a flowchart showing an example of 
document processing procedure in the image processing 
apparatus shown in FIG. 12. Of the flowchart of the 
constitution in FIG. 1 shown in FIG. 2, herein, the 

20 data conversion process (step ST205) is changed to 

application starting process (step ST209) and the image 
forming process (step ST2 06) is changed to application 
processing result forming process (step ST210). 

After determining the document type of the image 

25 data input in the image type determining unit 103, in 

the application starting unit 109, an application 
suited to image processing according to the type of the 
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document corresponding to the type of the image date is 
selected, the starting parameter is determined, and the 
application is started (step ST209). 

FIG. 14 is a flowchart showing the detail of 
5 application starting process as an example in the 

application starting unit 109, which is a flowchart of 
the process corresponding to step ST209 shown in 
FIG. 13. 

The image type information 161 is the output of 

10 the image type determining unit 103, and expresses the 

type of input image data, which is one of dot photo 
original 153, dot background original 154, continuous 
gradation photo original 155, uniform background 
original 156, rectangle discriminative original 157, 

15 and indiscriminative original 158. 

First, it is checked if the image type information 
161 is an indiscriminative original or not (step ST801) . 
If not indiscriminative original, next it is checked if 
rectangle discriminative original or not (step ST802). 

2 0 In the case of rectangle discriminative original, 

making use of the information of the pixel attribute 
obtained in the region discriminating unit 102, the 
application is started on the input image data in every 
rectangular region, and various image processings are 

25 done (step ST803) . 

The application includes, for example, image 
filing, printing, facsimile transmission, layout 
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understanding, character recognition, rule extraction 
and other image processings. A rule of application for 
starting may be preset in every pixel attribute, and 
the application starting process may be done according 
5 to this rule. For example, in the case of character 

region, by layout understanding, the column setting or 
other document structure may be recognized, and the 
characters may be encoded by character recognition. Or, 
in the case of dot photo region or continuous gradation 

10 photo region, the image filing may be started in order 

to save the image, or when printing, if the region is 
color, by attaching a starting parameter of color, the 
printer at the output destination may be automatically 
changed to a color printer. The result processed by 

15 the application is the application processing result 

data 165, which may be provided in various formats such 
as printout, file, or character recognition result. By 
thus presetting the rule of application starting 
process in every pixel attribute, as soon as the image 

20 data is input, various processings may be done 

automatically . 

If it is not rectangle discriminative original at 
step ST802, the entire image is uniformly processed by 
starting the application (step ST804). As uniform 

25 image format conversion process, for example, in the 

case of uniform background original, which does not 
include photograph, by layout understanding, the 
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document structure such as paragraph is recognized, and 
the character can be encoded by character recognition, 
or in the case of dot photo original or continuous 
gradation photo original, the image filing may be 
5 started for saving the image, or printing or facsimile 

transmission can be done directly. The result of 
processing by the application is, similarly to at step 
ST803, it is the application process result data 165, 
and various formats may be provided, such as printout, 

10 file and character recognition result. 

In the case of indiscriminative original at step 
ST801, without application starting process by using 
the information of the pixel attribute obtained in the 
region discriminating unit 102, the input image data is 

15 directly output as application process result data, or 

by starting the image filing or the like, the image 
data is directly stored as file, and the processing may 
be selected later by the determination of the user 
(step ST805) . 

20 Thus, since the application for processing the 

image is started according to the determined type of 
the image data by determining the type of the input 
image data from the result of discriminating the region, 
it is possible to perform various processes as soon as 

25 the image data is input, so that the labor may be saved. 

As described herein, the image processing 
apparatus of the present invention is designed to 
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incorporate a document image through an image input 
unit 101, extract one physically or logically coupled 
from the status of data of each pixel and adjacent 
pixels in the region discriminating unit 102 as one 
region, measure the feature quantities such as position, 
size, shape, structure and density distribution of each 
region on the image, and discriminate the measured 
result as a region having the attribute such as 
character, photograph, dot or the like as the document 
constituent element according to a predetermined rule. 
On the basis of the attribute information or the like, 
the type of the document depending on the type of the 
image data is determined from the feature such as 
complicatedness of the entire document image input in 
the image type determining unit 103, and the image data 
format is converted in the data converting unit 104 
depending on the type of the document corresponding to 
the type of the image data. 

In the image correcting unit 106, by processing to 
correct the image data by adequate density conversion 
or filter processing according to the type of the 
document corresponding to the type of the image data, 
in the image format changing unit 107, the image format 
suited to be stored in the image memory 108 is selected 
according to the document type corresponding to the 
type of the image data, and it is processed to be 
converted into this format. 
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Further, in the application starting unit 109, 
selecting an application suited to image processing 
according to the type of the document corresponding to 
the type of the image data, the starting parameter is 
5 determined, and it is made possible to process to start 

the application. 

Therefore, in the original image data input in the 
apparatus, by extracting the region by distinguishing 
the different document elements such as character, 

10 photograph, drawing, table, and dot, the feature 

quantities such as presence or absence of key region 
such as dot and photograph, and complicatedness as 
document structure from the degree of overlapping of 
rectangular region are determined, and hence it is 

15 possible to determine what kind of document is the 

input image data, and by making use of the determining 
result, it is possible to convert into efficient image 
data less in deterioration of image quality, or correct 
image in order to obtain image data of high quality. 

2 0 When saving as image file, the format suited to 

the image data can be selected automatically, and 
efficient filing is realized. 

Further, as soon as the document image data is 
input, the image processing application is selected and 

25 started automatically, so that the labor is saved. 

Further, as other embodiments relating to the 
image processing apparatus, image forming apparatus, 
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and image processing method of the present invention, 
fifth to twelfth embodiments are described specifically 
below while referring to the accompanying drawings . 
< Fifth Embodiment > 
5 A fifth embodiment is shown in FIG. 15, which 

presents an image forming apparatus for composing an 
image quality parameter as shown in FIG. 15, in 
addition to the first embodiment . An electronic copier 
usually comprises an image input unit such as scanner, 

10 an image processing unit, and an image forming unit 

such as printer. The electronic copier also includes 
an operation unit (control panel) to be used by the 
user for making various settings . The operation unit 
has an image quality parameter input unit as described 

15 later, and an image quality adjusting parameter is 

input according to the user's preference of image 
quality. 

That is, in FIG. 15, the image forming apparatus 
comprises an image input unit 1, a page information 

20 discriminating unit 2, an image processing unit 3, and 

an image forming unit 4 . The image f orraing apparatus 
is connected with an image parameter input unit 31 for 
inputting an image quality adjusting parameter 
according to the user's preference of image quality, an 

25 image quality storing unit 32 for storing the image 

quality parameter input by the image quality parameter 
input unit 31, and an image quality parameter deciding 
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unit 33 for deciding the image quality parameter to be 
processed in the image processing unit 3 on the basis 
of the image quality parameter stored in the image 
quality parameter storing unit 32 . 
5 Referring to FIG. 15, the embodiment of the 

present invention is described in detail below. 

First, the image input unit 1 is, for example, a 
color CCD scanner, which reads the original color image 
and separates into electric signals of three primaries, 

10 R (red), G (green), B (blue), vertically and 

horizontally, converts into 8-bit digital data of each 
color in each unit pixel (for example, 400 dpi), and 
outputs as R, G, B, respectively. 

Image signals of R, G, B are input into the page 

15 information discriminating unit 2 for discriminating 

the type of the entire image, and the image processing 
unit 3 . 

FIG. 16 shows an example of the image processing 
unit 3, which is composed of a color converting unit 51 

20 a space filter 52, a black color unit 53, a y- 

correction unit 54, and a gradation processing unit 55, 
and in each block the page information output by the 
page information discriminating unit 2 is input 
together with the image signals output by all blocks . 

25 In the color converting unit 51, signals of R, G, 

B input from the scanner are converted in the following 
formula 1, and signals of C (cyan), M (magenta), and Y 
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(yellow) corresponding to the signals of the image 
forming unit 4 are obtained. 
Dr = -log R 
Dg = -log G 
5 Db = -log B 

C'] fail ai2 aisVor^ 
M = ^21 a22 a23 Dg 
I,a3i a32 ass j l,DbJ 

This operation is composed of the circuit shown in 

FIG. 17. The color converting unit 51 is composed of 

10 look-up tables (LUT) 61a to 61c for log conversion, 

nine multipliers 62a to 62i for 3X3 matrix operation, 
and three adders 63a to 63c. 

In the color converting unit 51, the method of use 
of page discrimination signal is, for example, as 

15 follows. First, as the types of original image data 

mentioned in the first embodiment, or the types of 
individual documents (called page discrimination 
information hereinafter), uniform background (having 
characters), dot background (having characters), dot 

20 photo (having photo only), and continuous photo (having 

photo only) are defined. In these four types of images, 
generally, it is known that the blue color is strong in 
the case of continuous photo using photographic 
printing paper. It is therefore preferred to change 

25 the color reproducibility only in the case of 

continuous photo. To change the color reproducibility, 
it is necessary to change the coefficients all to a33 
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of the color conversion matrix. That is, preparing 
coefficients all to a33 for continuous photo, and 
coefficients all to a33 for other image, they are 
changed over on the basis of the page discrimination 
5 information. 

The space filter 52 is composed of, for example, a 
high frequency component calculating unit 71, a 
multiplier 7 2 for operating the weight of high 
frequency component, and s subtracting unit 7 3 of the 

10 original image as shown in FIG. 18. The high frequency 

component calculating unit 71 is to operate, for 
example, 3X3 Laplacian filter, and emphasize the high 
frequency component of the original image, and it is 
composed of a filter as shown in FIG. 19. 

15 FIG. 20 shows a specific example of circuit 

constitution of the space filter 52, in which the high 
frequency component calculating unit 71 is composed of 
flip-flop circuits 71a to 71f, multipliers 71g to 71p, 
and adder 71q. This circuit is required for each color 

20 of C, M and Y. Herein, the weighting coefficient K is 

an image quality parameter determined by the image 
quality parameter deciding unit 33, and by adjusting 
this weighting coefficient K, the sharpness of image 
can be adjusted. 

25 The method of using the page discrimination 

information in this space filter 52 is the method of 
changing the filter coefficient or weighting 
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coefficient K on the basis of the page discrimination 
information shown in FIG. 19. For example, in the case 
of uniform background or continuous photo, the filter 
weighting coefficient K is large, and in the case of 
5 dot background or dot photo, the weighting coefficient 

K is set smaller in order to suppress dot moire. 

The black color unit 53 processes to generate 
signal of C (cyan), M (magenta), Y (yellow), and K 
(black) from the signals of C (cyan), M (magenta), and 
10 Y (yellow), and, for example, the UCR processing is 

done as shown in the formula below. 
K = aXmn(C, N, Y) 

C = C-K 

M' = M-K 
15 Y' = Y-K 

a: parameter for determining the amount of black 

color 

This operation is composed of, for example, the 
circuit shown in FIG. 21. This circuit is composed of 

20 comparators 81a, 81b, selectors 82a, 82b, and 

subtracters 83a to 83c. 

The method of utilizing page discrimination in the 
black color unit 5 3 is, for example, a method of 
changing the black color rate (a) in every type of 

25 image. In the uniform background or dot background 

having characters, by setting the black color rate (a) 
higher, black characters are reproduced more easily in 
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a single black color, and the character reproducibility 
is enhanced. In the case of dot photo or continuous 
photo, the color reproducibility is improved by setting 
the black color rate (a) lower. 
5 The 7 -correction unit 54 is a block used for 

correcting the density characteristic of the printer 
unit of each color of C, M, Y, and adjusting the 
density by the user, and a simplest constitution is a 
look-up table (LUT) 90 of input of 8 bits and output of 

10 8 bits as shown in FIG. 22. In this table, for example, 

a density conversion curve as shown in FIG. 2 3 is set. 
The default is, for example, a curve of 0 (a curve 
equal in input and output), and when the user adjusts 
the density, a density curve corresponding to -3 to +3 

15 is selected and set according to the determined image 

quality parameter. 

In the y -correction unit 54, the following setting 
method using page discrimination information is 
available. For example, in the case of uniform 

2 0 background or dot background having characters, as the 

7 -curve used as y -correction, a high- 7 table is 
prepared and set. As a result, the reproducibility of 
characters is enhanced. On the other hand, in the case 
of dot photo or continuous photo, a table of linear 

25 input and output is set for improving the gradation 

reproducibility. 

The gradation processing unit 55 is to process to 
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convert 8-bit signal of C, M, K into, for example, 1 
bit (binary), and the error diffusion method is known 
as a representative method. 

In the error diffusion method, a binary error of 
5 an already binary peripheral pixel is multiplied by a 

certain weighting coefficient, and this product is 
added to the density of the pixel of notice, and a 
binary value is obtained by fixed threshold. FIG. 24 
is a structural block diagram of binary process by 

10 error diffusion method. In FIG. 24, the binary circuit 

includes an input image signal 40, a correcting unit 41 
for correcting image information of pixel of notice, a 
corrected image signal 411, a binary unit 42 for 
obtaining a binary value from the corrected image 

15 information of pixel of notice, a binary image signal 

421, a binary error calculating unit 43 for calculating 
the binary error of binary pixel of notice, a binary 
error signal 431, a weighting coefficient memory unit 
44 for storing the weighting coefficient for 

2 0 calculating the weighting error, a weighting error 

calculating unit 45 for calculating a weighting error 
by multiplying the binary error calculated in the 
binary error calculating unit 43 by the weighting 
coefficient of the weighting error memory unit 44, a 

25 weighting error signal 451, an error memory unit 46 for 

storing the weighting error calculated in the weighting 
error calculating unit 45, and an image correction 
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signal 461. The binary process of the error diffusion 
method is described in detail below. 

The input image signal 40 of the y -correction unit 
55 is corrected by the image correction signal 461 
5 described later, and a corrected image signal 411 is 

output. The corrected image signal 411 is compared 
with a binary threshold Th (for example, in 80h, "h" 
denotes hexadecimal notation) in the binary unit 42, 
and when the corrected image signal 411 is larger than 

10 the binary threshold Th, "1" (black pixel) is output as 

binary image signal 421, and "0" (white pixel) is 
output when smaller. In the binary error calculating 
unit 43, the difference between the corrected image 
signal 411 and binary image signal 421 (herein, however 

15 it is Oh when binary image signal is "0", and ffh when 

"1") is calculated, and it is output as binary error 
signal 431. In the weighting error calculating unit 45 
the binary error signal 431 is multiplied by the 
weighting coefficients A, B, C, D (A=7/16, B=l/16, 

20 C=5/16, D=3/16) of the weighting coefficient memory 

unit 44, and the weighting error 451 is calculated. 
Herein, the * mark in the weighting coefficient memory 
unit 44 indicates the position of pixel of notice, and 
the binary error of the pixel of notice is multiplied 

25 by the weighting coefficients A, B, C, D, and the 

weighting error of four peripheral pixels of the pixel 
of notice (pixels corresponding to the positions of the 
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weighting coefficients A, B, C, D) is calculated. The 
error memory unit 46 is to store the weighting error 
451 calculated in the weighting error calculating unit 
45, and the weighting errors of four pixels calculated 
5 in the weighting error calculating unit are added and 

stored in the regions of eA, eB, eC, eD corresponding 
to the pixel of notice * , The image correction signal 
461 is a signal at position of *, and is a cumulative 
signal of weighting errors of four pixels calculated in 

10 the above procedure. 

In the above explanation of gradation processing 
unit 55, the output is binary, but by preparing a 
plurality of binary thresholds Th and comparing with 
the input image signal, multi-value processing is same 

15 as in binary value. 

In the gradation processing unit 55, for example, 
the page discrimination information is utilized as 
described below. First, FIGS. 25A and 25B show two 
cases of output of the gradation processing unit 55. 

2 0 In FIG. 25A, the laser modulator, not shown, of 

the image forming unit 4 is modulated in the unit of 
two pixels, and as determined from the diagram, the 
resolution is 1/2, but since the pixel size is small 
even at the same gradation level, the gradation output 

25 withstands fluctuation of recording, and an image can 

be formed on the basis of a stable output. 

In FIG. 25B, on the other hand, the laser is 
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driven in the unit of one pixel, and the resolution is 
high although stability of density fluctuation is 
insufficient. That is, the one-pixel modulation method 
of high resolution is employed in the case of uniform 
5 background or dot background having characters, and the 

two-pixel modulation method of high density stability 
is employed in the case of dot photo or continuous 
photo . 

Examples of use of page discrimination 
10 information in each process are presented herein, but 

the method of use is not limited to these examples 
alone, but various methods may be considered. 

So far is shown an example of structure of the 
image processing unit 3, and thus processed signals of 
15 C (cyan), M (magenta), Y (yellow), and K (black) are 

input in the image forming unit 4 , and an image is 
formed and output on a paper. 

In such constitution, an embodiment of the page 
information discriminating unit 2 in the fifth 
2 0 embodiment operating same as in the first embodiment is 

described below. 

FIG. 26 shows an example of structure of the page 
information discriminating unit 2 . The page 
information discriminating unit 2 is composed of region 
25 discriminating unit 102 and original type determining 

unit 103 shown in FIG. 1. 

The page information discriminating means 2 takes 
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in a document image, in the region discriminating means 
21 J one coupled physically or logically from the 
situation of each pixel and vicinal pixel data is 
extracted as one region, feature quantities of each 
5 region such as position on the image, size, shape, 

structure, and density distribution are measured, and 
the result of measurement is discriminated as the 
region having attribute such as character, photograph, 
and dot as the document constituent elements according 

10 to a preset rule. On the basis of the attribute 

information and others , in the original type 
determining unit 103, the type of the document is 
decided from the features of the entire input document 
image, and the image data format can be converted 

15 according to the type of the document. 

The structure and operation of the region 
discriminating unit 102 and original type determining 
unit 103 are same as in the first embodiment shown in 
FIG. 1 and after, and their description is omitted 

20 herein. 

< Sixth Embodiment > 

The foregoing description relates to an example of 
using the page discrimination information only when 
determining the processing conditions in each process 
25 of the image processing unit, but in a sixth embodiment 

shown in FIG. 27, rectangle discrimination information 
(image type of plural regions) is used together with 
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the page discrimination information. 

In FIG. 21, the page discrimination information 
and rectangle discrimination information are used as 
the processing conditions in each process of the image 
5 processing unit. As compared with the constitution in 

FIG. 15, a region discriminating unit 6 is added, and 
together with the page discrimination information 
output by the page information discriminating unit 2, 
the rectangle discrimination information output by the 

10 region discriminating unit 6 is input into the image 

processing unit 7 . By using both page discrimination 
information and rectangle discrimination information, 
more specific parameter setting is possible in the 
image processing unit 7 . 

15 For example, the page discrimination information 

is the information shown in FIG. 28A. Herein, "0. 
Region discrimination" shows that the rectangle 
discrimination information output by type region 
discriminating unit 6 is valid, and "1. Uniform 

20 background to 4. Continuous photo" means that the page 

discrimination information output by the page 
information discriminating unit 2 is valid. 

When the page discrimination information is "0. 
Region discrimination," using the discrimination result 

25 of the rectangle unit of the region discriminating unit 

3, the image processing condition is changed in the 
rectangle unit in the image processing unit 3. On the 



- 51 



other hand, when the page discrimination information is 
"1. Uniform background to 4. Continuous photo," this 
information is used as the discrimination information 
in the page unit, and the image processing unit 4 sets 
5 the image processing condition on the basis of this 

information, and executes a specific processing in the 
image unit. Thus, by using the page discrimination 
information, as compared with the conventional image 
copying apparatus generally having five operation modes 

10 shown in FIG. 2 8B as the operation modes (operation 

modes corresponding to the type of the original to be 
copied) , an automatic mode can be provided as shown in 
FIG. 28C (the mode for selecting a mode for executing 
specific process image unit and a mode for executing 

15 the process by changing the processing condition in the 

unit of rectangle or pixel, automatically on the basis 
of the page discrimination information and outputting ) , 
so that an image of a higher image quality than in 
character /photo mode can be obtained. 

20 When the page discrimination information is "5. 

Indiscriminative, " it means all of "0. Region 
discrimination to 4. Continuous photo" are invalid, 
and none of the discrimination information can be used. 
Therefore, in the image processing unit 7, specific 

25 processing is done in the entire image without using 

discrimination information, or the type of image 
discriminated in the pixel unit in a method explained 
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below, and the image is processed. 
< Seventh Embodiment > 

A seventh embodiment is shown in FIG. 29, in which 
the discrimination process in pixel unit is further 
5 added to the first embodiment. FIG. 29 shows an 

example of structure of an image processing unit 7 when 
executing image processing by discriminating in the 
pixel unit . 

The image processing unit 7 shown in FIG. 29 is 

10 similar to the image processing unit 3 for inputting 

page discrimination information shown in FIG. 16, 
except that a pixel unit discriminating unit 56 is 
added. In the constitution in FIG. 16, specific page 
discrimination information for entire image is input in 

15 the color converting unit 51 to gradation processing 

unit 55, and each image processing is determined in the 
image processing condition on the basis of its page 
discrimination information. In the constitution of the 
image processing unit 7 in FIG. 29, instead of the page 

20 discrimination information, the pixel unit 

discriminating unit 56 discriminates the type of image 
in the pixel unit on the basis of the input image 
information, and processes by setting the image 
processing condition in each image processing block on 

25 the basis of this discrimination information. 

The processing method in the pixel unit 
discriminating unit 56 includes, for example, a method 
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of separating three regions of character, photo, and 
dot photo, as disclosed in "Block Separate 
Transformation Method (BSET) " in "Discrimination 
Processing Method of Dot Photograph" (J. of Japan 
5 Society of Electronics, Information Communication, Vol. 

J70-B, No. 2, February 1987). 

In this method, the object image is divided into 
blocks, and three regions are separated by density 
change within blocks. At this time, it is intended to 
10 make use of nature of density changes, that is: 

- Photograph is small in density change in block. 

- Character and dot photograph are large in 
density change in block. 

- Character is large in period of density change. 
15 - Dot photograph is small in period of density 

change . 

The detail is described below. 

(1) The object image is divided into blocks of 
(mXn) pixels. 

2 0 (2) Maximum density signal Dmas and minimum 

density signal Dmin in block are determined, and 
maximum density difference signal ADmax in block is 
calculated. 

(3) Comparing preset threshold Thl and ADmax, 
25 photo region and non-photo resin (character and dot 

photo region) are separated in the following condition. 
ADmax ^ Thl Photo region 



Admax > Thl Non-photo region 

(4) Each pixel in block is coded into binary 
signal (0/1) by average signal Da of signal in block. 

(5) The niimber of times of 0/1 change Kh between 
pixels consecutive in the main running direction in 
block is determined. Similarly, in the sub-scanning 
direction, the number of times of changes Kv is 
determined . 

(6) Comparing preset threshold Th2 and Kh and Kv, 
the character region and dot photo region are separated 
in the following condition. 

Kh ^ Th2 and Kv ^ Th2 Dot photo region 
Kh < Th2 and Kv < Th2 Character region 

In this procedure, the character, photo, and dot 
photo regions can be separated. 

FIG. 30 shows an example of circuit configuration 
of pixel unit discriminating unit 56, which is a 
circuit for calculating the maximum density difference 
ADmax in 4X4 window (shaded areas showing pixel of 
notice) shown in FIG. 31. This circuit is composed of 
selector 12a, comparators 12b to 12g, and subtracter 
12h. 

<Eighth Embodiment> 

An eighth embodiment is shown in FIG. 32, in 
which a case of setting the processing condition of 
pixel unit discriminating unit 56 by using page 
discrimination information is explained, and this is an 
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effective method for enhancing the precision of 
discrimination . 

FIG. 32 shows a constitution of using page 
discrimination information in the pixel unit 
discriminating unit 8 . The operation of the page 
information discriminating unit 2 is as explained 
already, and the pixel unit discriminating unit 8 
receives the page discrimination information together 
with the input image data of the image input unit 1, 
and sets a parameter for discrimination on the basis of 
the page discrimination information. 

First, as page discrimination information, four 
pieces of information shown in FIG. 28D are output, and 
a discriminating method of pixel unit is explained in a 
case of discriminating the character region by using 
the maximum density difference AOmax. When using the 
maximum density difference ADmax, it is known that 
separation into dot region and character region is 
difficult. Therefore, using page discrimination 
information, it is set at threshold Th=thl in the 
uniform background region, at Th==th2 in the dot photo 
region, and Th=th3 in the dot photo and continuous 
photo region (where thl>th2>th3 ^0). By thus setting, 
the photo region is not falsely discriminated as 
character region, and characters in the dot background 
region which are difficult to discriminate can be 
lowered in the rate of false discrimination in the 
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non-character region, so that very effective pixel unit 
discrimination may be realized. 
<Ninth Embodiment > 

A ninth embodiment is shown in FIGS. 28A and 29, 
5 in which the duration of time necessary for 

discriminating process is evaluated by using "Time 
over" prepared as page discrimination information, and 
it is decided whether or not to use the page 
discrimination information according to the result. 
10 Thus, the certainty of region recognition can be 

attained as far as possible in the range of processing 
time . 

That is, in FIG. 2 8A, "6. Time over" is provided 
as page discrimination information. The original type 

15 discriminating unit 22 shown in FIG. 26 is more 

preferably realized by the software, and therefore the 
processing time differs depending on the type of the 
original to be input. Therefore, the discriminating 
process may not be terminated within the required 

20 processing time of the image forming apparatus. This 

page discrimination information "6. Time over" is, by 
measuring the time required for discriminating process, 
set when it is not terminated within the processing 
time specified in this system. In such a case, the 

25 image processing unit 7 discriminates in the pixel unit 

without using page discrimination information as 
explained already in, for example, FIG. 29, and 
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processes the images according to this discrimination 
information, thereby finishing within the preset range 
of processing time. 

<Tenth Embodiment > 
5 A tenth embodiment is shown in FIG. 33, and using 

"Indiscriminative" prepared as page information 
similarly, it is designed to evaluate the discrimi- 
nation precision of discriminating process, and execute 
discriminating process appropriately according to it. 

10 That is, the original type discriminating unit 2 2 

outputs information such as "5. Indiscriminative" as 
shown in FIG. 28A. It corresponds to the flow of 
discriminating process at step ST403 in FIG. 4. 

FIG. 33 shows a constitution of this embodiment. 

15 The image forming apparatus in FIG. 33 comprises 

an image input unit 1, a page information 
discriminating unit 2, an image dividing unit 10, a 
region discriminating unit 11, a discrimination 
precision determining unit 12, a selecting unit 13, an 

20 image processing unit 14, and an image foirming unit 4. 

In this constitution, when the discrimination 
precision is poor, it is determined to be 
indiscriminative, and in such a case, therefore, the 
image processing unit 14 or 19 discriminates the pixel 

25 unit without using page discrimination information as 

explained already, for example, in FIG. 29, and it is 
possible to process images on the basis of this 
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discrimination information. In this way, effects of 
poor discrimination result of discrimination precision 
can be avoided, and processing result of a specific 
level may be maintained. 
5 <Eleventh Embodiment > 

An eleventh embodiment is shown in FIG. 34, 
and using " Indis criminative " prepared as page 
information similarly, it is designed to evaluate the 
compile atedness of discriminating process, and execute 

10 discriminating process appropriately according to it. 

FIG. 34 shows a constitution of this embodiment. 
The image forming apparatus in FIG. 34 comprises 
an image input unit 1, a page information discrimi- 
nating unit 2, a complicatedness determining unit 15, 

15 an image dividing unit 16, a region discriminating unit 

17, a selecting unit 18, an image processing unit 19, 
and an image forming unit 4 . 

In this constitution, when the complicatedness of 
the object image is very high, it is determined to be 

20 indiscriminative, and in such a case, therefore, the 

image processing unit 14 or 19 discriminates the pixel 
unit without using page discrimination information as 
explained already, for example, in FIG. 29, and it is 
possible to process images on the basis of this 

25 discrimination information. In this way, adverse 

effects of discrimination result when the 
complicatedness is high can be avoided, and processing 



- 59 - 



result of a specific level may be maintained. 

The foregoing embodiments are representative 
methods using the page discrimination information, and 
a further different embodiment is shown in FIG. 35. 
5 <Twelfth Embodiment> 

A twelfth embodiment is shown in FIG. 35, in which 
the image is processed preliminarily by plural types of 
image processing conditions depending on the image 
information, if obtained without waiting for output of 

10 the discrimination result of page information in order 

to increase the processing speed, it is stored in the 
memory region, and when the discrimination result is 
obtained, the result of image processing corresponding 
to it is read out from the memory region. Thus, by 

15 parallel operation of discriminating process of image 

type and image processing of plural types, the 
processing speed can be increased on the whole. 

The image forming apparatus in FIG, 35 comprises 
an image input unit 1, a page information discrimi- 

20 nating unit 2, image processing units 25, 26, a 

storing/reading unit 27, a memory unit 28, and an image 
forming unit 4 . This constitution has two image 
processing units 25, 26, and memory unit 28 for saving 
the processing results output by the image processing 

25 units 25, 26, and it is designed to output the image by 

selecting and reading from the stored plural image 
processing results by the page information 
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discriminating unit 2 . 

In the image processing unit 25 and image 
processing unit 26, it is designed to process by two 
kinds of image processing conditions regardless of the 
5 page discrimination information, for example, the image 

processing parameter suited to character image and 
image processing parameter suited to photo image. The 
two kinds of image processing results are stored in the 
memory unit 28, for example, memory or HDD, and when 

10 the processing result output by the page information 

memory unit 2 is uniform background or dot background, 
the image processing result for character processed by 
the image processing unit 2 5 is read out from the 
storing/reading unit 27, and on the other hand, when 

15 the page information output by the page information 

discriminating unit 2 is dot photo or continuous photo, 
the image processing result for photo processed by the 
image processing unit 2 6 is read out from the memory 
unit 2 8 and output. 

20 In such constitution, it is possible to operate 

processing of the page information discriminating unit 
2 and processing of the image processing units 25, 26 
parallel (that is, image processing is done in the 
image processing units 25, 26 without waiting for 

25 output of the page information discriminating unit 2), 

so that high speed operation is possible in the image 
forming apparatus . 
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As explained already, the image processing unit 3 
shown in FIG. 15 makes use of the page discrimination 
information used in each image processing shown in 
FIG. 16, and the relation between the original mode 
5 showing the operation mode of the apparatus and the 

processing condition of page discrimination information 
and each image processing block is shown in FIG. 36. 

In FIG. 36, the page discrimination result shows 
the page discrimination information shown in FIG. 2 8A, 

10 such as character/photo, character, map, printed photo, 

and photo in photographic printing paper shows the 
processing condition of each image processing such as 
color conversion, background processing, . . . , gradation 
processing, and it means the same condition as when 

15 each is selected as the original mode. The processing 

condition of each image processing for the same page 
discrimination information is not always the same, and 
symbols such as A, B, ... denote variations of 
parameters slightly different from the case when 

2 0 selected as original mode, and it is necessary to 

divide into proper groups or into further small 
divisions depending on the image processing. 

As explained herein, according to the embodiments 
of the present invention, if character and photograph 

25 are mixed, the character /photo mode is selected as the 

original mode, and the region or entire image is 
automatically discriminated as one category, and the 
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image processing is done so as to obtain the optimum 
image quality. 

Further, in discrimination done by the apparatus 
in the character/photo mode, not only the discrimi- 
5 nation of the region but also discrimination 

information of entire image are output, and therefore 
the recognition precision can be enhanced, so that 
deterioration of image quality due to wrong recognition 
of type of image can be suppressed. 

10 Further, to decrease the problems of such wrong 

recognition, such process as to decrease the difference 
in processing between categories to be discriminated 
(for example, character and photo) and make the 
deterioration of image quality due to wrong recognition 

15 less obvious even when discriminated falsely, and an 

output of higher image quality can be obtained as 
compared with the prior art . 

As described specifically herein, the present 
invention presents an image processing apparatus 

2 0 capable of suppressing deterioration of image quality 

due to wrong discrimination in region discrimination, 
and an image forming apparatus and an image processing 
method capable of forming an image at high quality by 
processing appropriately depending on the type of the 

25 image data. 

Additional advantages and modifications will 
readily occur to those skilled in the art. Therefore, 



the invention in its broader aspects is not limited to 
the specific details and representative embodiments 
shown and described herein. Accordingly, various 
modifications may be made without departing from the 
spirit or scope of the general inventive concept as 
defined by the appended claims and their equivalents. 
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WHAT IS CLAIMED IS: 

1. An image processing apparatus comprising: 
input means for inputting image data of an 

original image; 
5 discriminating means for extracting a 

predetermined region by using a feature of pixel of the 
image data input from the input means , and for 
discriminating an attribute of the region; 

determining means for determining the type of the 
10 image data on the basis of the distribution of the 

regions attribute of which discriminated by the 
discriminating means ; and 

processing means for processing the image data as 
specified depending on the type of the image data 
15 determined by the determining means . 

2. An image processing apparatus according to 
claim 1, wherein the determining means includes: 

means for determining the type of the image data 
as at least one type selected from the group consisting 

20 of image data of uniform background, image data of dot 

background in the entire screen, image data of dot 
photo only, image data of continuous gradation photo 
only, image data of which region can be discriminated 
by rectangle, and image data of which region cannot be 

25 discriminated by rectangle. 

3. An image processing apparatus according to 
claim 1, wherein the processing means includes: 
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means for converting at least one of resolution, 
compression rate, and nximber of colors of the image 
data, depending on the type determined by the 
determining means . 

4 . An image processing apparatus according to 
claim 1, wherein the processing means includes: 

correcting means for correcting the image data by 
performing at least one of density conversion and 
filter processing, depending on the type determined by 
the determining means . 

5. An image processing apparatus according to 
claim 1, wherein the processing means includes: 

changing means for changing the image format of 
the image data, depending on the type determined by the 
determining means . 

6. An image processing apparatus according to 
claim 1, wherein the processing means includes: 

processing means for selecting an application of 
image processing, depending on the type determined by 
the determining means, setting a parameter, and 
starting this application to perform image processing 
of the image data. 

7. An image processing apparatus according to 
claim 1, wherein the processing means includes: 

means for performing specified processing on the 
basis of the attribute of the region discriminated by 
the discriminating means , on the image data in every 
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region, when the determining result by the determining 
means is a specified result. 

8. An image processing apparatus according to 
claim If wherein the processing means includes: 

second discriminating means for discriminating the 
image type of the image data received from the input 
means in pixel unit, when the determining result by the 
determining means is a specified result; and 

second processing means for processing the image 
data as specified, on the basis of the result 
discriminated by the second discriminating means . 

9. An image processing apparatus according to 
claim 1, wherein the processing means includes: 

setting means for setting for pixel unit 
discriminating process on the basis of the determining 
result by the determining means ; 

second discriminating means for discriminating the 
image type of the image data received from the input 
means in pixel unit on the basis of the setting by the 
setting means, when the determining result by the 
determining means is a specified result; and 

second processing means for processing the image 
data as specified, on the basis of the result 
discriminated by the second discriminating means . 

10. An image processing apparatus according to 
claim 1, wherein the processing means includes: 

second discriminating means for discriminating the 
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image type of the image data received from the input 
means in pixel unit, when the determining means 
determines that it takes more than a specified time for 
determining; and 

second processing means for processing the image 
data as specified, on the basis of the result 
discriminated by the second discriminating means . 

11. An image processing apparatus according to 
claim 1, wherein the processing means includes: 

second discriminating means for determining the 
discrimination precision of the discriminating means, 
and when this discrimination precision is below a 
specific value, discriminating the image type of the 
image data received from the input means in pixel unit; 
and 

second processing means for processing the image 
data as specified, on the basis of the result 
discriminated by the second discriminating means . 

12 . An image processing apparatus according to 
claim 1, wherein the processing means includes: 

second discriminating means for determining the 
complicatedness of the discriminating means, and when 
this complicatedness is above a specific value, 
discriminating the image type of the image data 
received from the input means in pixel unit; and 

second processing means for processing the image 
data as specified, on the basis of the result 
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discriminated by the second discriminating means . 

13. An image processing apparatus according to 
claim 1, further comprising: 

storing means for receiving the image data from 
5 the input means, performing a first process on the 

image data parallel to the determining process of the 
determining means to obtain a first result, further 
performing a second process different from the first 
process to obtain a second result, and storing them in 
10 a memory region; and 

means for reading out and outputting either one of 
the first result and second result from the storing 
means on the basis of the determining result of the 
determining means . 
15 14. An image processing apparatus according to 

claim 1/ wherein the discriminating means and judging 
means inc lude : 

means for discriminating the structure of the 
background from the extracted region, and judging the 
20 type of the image data on the basis thereof. 

15. An image processing apparatus according to 
claim 1, wherein the judging means includes: 

means for judging presence or absence of character 
from the distribution of attribute in each region 
25 discriminated by the discriminating means, and judging 

the type of the image data on the basis thereof. 

16. An image processing apparatus according to 
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claim 1, wherein the judging means and processing means 
include : 

judging means for judging the rectangle 
information and the type of the image data on the basis 
5 of the distribution of the attribute in each region 

discriminated by the discriminating means; and 

processing means for processing the data as 
specified on the basis of the rectangle information and 
the type of the image data judged by the judging means. 
10 17. An image processing apparatus according to 

claim 1, wherein the determining means includes: 

means for discriminating the page information 
which is the image type of each page of the original 
image of the image data when the discriminating means 
15 cannot divide the image data into a plurality of 

rectangular regions, and determining the type of the 
image data on the basis thereof. 

18. An image processing apparatus according to 
claim 1, wherein the determining means includes: 

20 means for discriminating the page information 

which is the image type of each page of the original 
image of the image data when the region extracted by 
the discriminating means has a complicatedness more 
than a specific value, and determining the type of the 

25 image data on the basis thereof. 

19. An image processing apparatus according to 
claim 1, wherein the judging means includes; 
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judging means for judging the type of the image 
data, regardless of the content of the original mode 
given from the user, on the basis of the distribution 
of the attribute of each region discriminated by the 
5 discriminating means . 

20. An image processing apparatus according to 
claim 1, wherein the processing means includes: 

second discriminating means for discriminating the 
image information of the image data received from the 
10 input means in the pixel unit according to the judging 

result when the judging result by the judging means is 
the specified result; and 

second processing means for processing the image 
data as specified on the basis of the discrimination 
15 result discriminated by the second discriminating means . 

21. An image forming apparatus comprising: 
input means for inputting image data of an 

original image; 

discriminating means for extracting a 
20 predetermined region by using a feature of pixel of the 

image data input from the input means , and for 
discriminating an attribute of the region; 

determining means for determining the type of the 
image data on the basis of the distribution of the 
25 regions attribute of which discriminated by the 

discriminating means; 

processing means for processing the image data as 
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specified depending on the type of the image data 
determined by the determining means; and 

image forming means for forming an image on a 
recording medium on the basis of the image data 
5 processed as specified by the processing means. 

22. An image processing method comprising: 
input step of inputting image data of an original 
image ; 

discriminating step of extracting a predetermined 
10 region by using a feature of pixel of the image data 

input at the input step, and for discriminating an 
attribute of the region; 

determining step of determining the type of the 
image data on the basis of the distribution of the 
15 attributes of the regions discriminated at the 

discriminating step; and 

processing step of processing the image data as 
specified depending on the type of the image data 
determined at the determining step. 
2 0 23. An image processing method according to 

claim 22, wherein the determining step includes: 

step of determining the type of the image data as 
at least one type selected from the group consisting of 
image data of uniform background, image data of dot 
25 background in the entire screen, image data of dot 

photo only, image data of continuous gradation photo 
only, image data of which region can be discriminated 
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by rectangle, and image data of which region cannot be 
discriminated by rectangle. 

24. An image processing method according to 
claim 22, wherein the processing step includes: 

5 step of converting at least one of resolution, 

compression rate, and number of colors of the image 
data, depending on the type determined at the 
determining step. 

25. An image processing method according to 
10 claim 22, wherein the processing step includes: 

correcting step of correcting the image data by 

performing at least one of density conversion and 

filter processing, depending on the type determined at 

the determining step . 
15 26. An image processing method according to 

claim 22, wherein the processing step includes: 

changing step of changing the image format of the 

image data, depending on the type determined at the 

determining step. 
20 27. An image processing method according to 

claim 22, wherein the processing step includes: 

processing step of selecting an application of 

image processing, depending on the type determined at 

the determining step, setting a parameter, and starting 
2 5 this application to perform image processing of the 

image data. 

28. An image processing method according to 
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claim 22, wherein the processing step includes: 

step of performing specified processing on the 
basis of the attribute of the region discriminated at 
the discriminating step, on the image data in every 
5 region, when the determining result at the determining 

step is a specified result. 

29. An image processing method according to 
claim 22, wherein the processing step includes: 

second discriminating step of discriminating the 
10 image type of the image data received from the input 

step in pixel unit, when the determining result at the 
determining step is a specified result; and 

second processing step of processing the image 
data as specified, on the basis of the result 
15 discriminated at the second discriminating step. 

30. An image processing method according to 
claim 22, wherein the processing step includes: 

setting step of setting for pixel unit 
discriminating process on the basis of the determining 
20 result at the determining step; 

second discriminating step of discriminating the 
image type of the image data received from the input 
step in pixel unit on the basis of the setting at the 
setting step, when the determining result at the 
25 determining step is a specified result; and 

second processing step of processing the image 
data as specified, on the basis of the result 
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discriminated at the second discriminating step. 

31. An image processing method according to 
claim 22 r wherein the processing step includes: 

second discriminating step of discriminating the 
5 image type of the image data received from the input 

step in pixel unit, when it is determined that it takes 
more than a specified time for determining at the 
determining step; and 

second processing step of processing the image 
10 data as specified, on the basis of the result 

discriminated at the second discriminating step. 

32. An image processing method according to 
claim 22, wherein the processing step includes: 

second discriminating step of determining the 
15 discrimination precision at the discriminating step, 

and when this discrimination precision is below a 
specific value, discriminating the image type of the 
image data received from the input step in pixel unit; 
and 

2 0 second processing step of processing the image 

data as specified, on the basis of the result 
discriminated at the second discriminating step. 

33. An image processing method according to 
claim 22, wherein the processing step includes: 

25 second discriminating step of determining the 

compile at edness at the discriminating step, and when 
this complicatedness is above a specific value. 
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discriminating the image type of the image data 
received from the input step in pixel unit; and 

second processing step of processing the image 
data as specified, on the basis of the result 
5 discriminated at the second discriminating step. 

34. An image processing method according to 
claim 22, further comprising: 

storing step of receiving the image data from the 
input step, performing a first process on the image 

10 data parallel to the determining process at the 

determining step to obtain a first result, further 
performing a second process different from the first 
process to obtain a second result, and storing them in 
a memory region; and 

15 step of reading out and outputting either one of 

the first result and second result stored at the 
storing step on the basis of the determining result at 
the determining step. 

35. An image processing method according to 

20 claim 22, wherein the discriminating step and judging 

step include: 

step of discriminating the structure of the 
background from the extracted region, and judging the 
type of the image data on the basis thereof. 
25 36. An image processing method according to 

claim 22, wherein the judging step includes: 

step of judging presence or absence of character 
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from the distribution of attribute in each region 
discriminated at the discriminating step, and judging 
the type of the image data on the basis thereof. 

37. An image processing method according to 

5 claim 22, wherein the judging step and processing step 

include the steps of: 

judging the rectangle information and the type of 
the image data on the basis of the distribution of the 
attribute in each region discriminated at the 
10 discriminating step; and 

processing the data as specified on the basis of 
the rectangle information and the type of the image 
data judged at the judging step. 

38. An image processing method according to 
15 claim 22, wherein the determining step includes: 

step of discriminating the page information which 
is the image type of each page of the original image of 
the image data when the discriminating step cannot 
divide the image data into a plurality of rectangular 
2 0 regions, and determining the type of the image data on 

the basis thereof. 

39. An image processing method according to 
claim 22, wherein the determining step includes: 

step of discriminating the page information which 
25 is the image type of each page of the original image of 

the image data when the region extracted at the 
discriminating step has a complicatedness more than a 
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specific value, and determining the type of the image 
data on the basis thereof. 

40. An image processing method according to 
claim 22, wherein the judging step includes a judging 

5 step of judging the type of the image data, regardless 

of the content of the original mode given from the user, 
on the basis of the distribution of the attribute o£ 
each region discriminated at the discriminating step. 

41. An image processing method according to 
10 claim 22, wherein the processing step includes: 

second discriminating step of discriminating the 
image information of the image data received from the 
input means in the pixel unit according to the judging 
result when the judging result at the judging step is 
15 the specified result; and 

second processing step of processing the image 
data as specified on the basis of the discrimination 
result discriminated at the second discriminating step. 
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ABSTRACT OF THE DISCLOSURE 
The present invention presents an image processing 
apparatus having an input unit for inputting image data 
of an original image, a discriminating unit for 
5 extracting a predetermined region by using a feature of 

pixel of the input image data, and for discriminating 
an attribute of the region, a determining unit for 
determining the type of the image data on the basis of 
the distribution of the attributes of the regions, and 
10 a processing unit for processing the image data as 

specified depending on the type of the determined image 
data. In this constitution, image processing 
conforming to the accurate discrimination result can be 
applied to image data. 
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DECLARATION AIMD POWER OF ATTORNEY 

As a below named inventor, I HEREBY DECLARE: 

THAT my residence, post office address, and citizenship are as stated below next to my 

name; 

THAT I believe I am the original, first, and sole inventor (if only one inventor is named 
below) or an original, first, and joint inventor (if plural inventors are named below or in an 
attached Declaration) of the subject matter which is claimed and for which a patent is sought on 
the invention entitled 

IMAGE PROCESSING APPARATUS, IMAGE FORMING APPARATUS, AND IMAGE 
PROCESSING METHOD DEPENDING ON THE TYPE OF ORIGINAL IMAGE 



(Attorney Docket No. 016907/1080) 



the specification of which (check one) 

is attached hereto. 

X was filed on March 17, 2000 as United States Application 

Number or POT International Application Number 

and was amended on 

(if applicable). 

THAT I do not know and do not believe that the same invention was ever known or used 
by others in the United States of America, or was patented or described in any printed 
publication in any country, before I (we) invented it; 

THAT I do not know and do not believe that the same invention was patented or 
described in any printed publication in any country, or in public use or on sale in the United 
States of America, for more than one year prior to the filing date of this United States 
application; 

THAT I do not know and do not believe that the same invention was first patented or 
made the subject of an inventor's certificate that issued in any country foreign to the United 
States of America before the filing date of this United States application if the foreign application 
was filed by me (us), or by my (our) legal representatives or assigns, more than twelve months 
(six months for design patents) prior to the filing date of this United States application; 

THAT I have reviewed and understand the contents of the above-identified specification, 
including the claim(s), as amended by any amendment specifically referred to above; 

THAT I believe that the above-identified specification contains a written description of 
the invention, and of the manner and process of making and using it, in such full, clear, concise, 
and exact terms as to enable any person skilled in the art to which it pertains, or with which it is 
most nearly connected, to make and use the invention, and sets forth the best mode 
contemplated by me of carrying out the invention; and 

THAT I acknowledge the duty to disclose to the U.S. Patent and Trademark Office all 
information known to me to be material to patentability as defined in Title 37, Code of Federal 
Regulations, §1.56. 
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1 HEREBY CLAIM foreign priority benefits under Title 35, United States Code §119(a)-{d) 
or § 365(b) of any foreign application(s) for patent or inventor's certificate, or §365(a) of any 
PCT international application which designated at least one country other than the United States 
of America, listed below and have also identified below any foreign application for patent or 
inventor's certificate or of any PCT international application having a filing date before that of 
the application on which priority is claimed. 



Prior Foreign 
Application Number 


Country 


Foreign Filing Date 


Priority 
Claimed? 

Yes 


Certified 

Copy 
Attached? 


11-094981 


Japan 


1 April 1999 




11-094982 


Japan 


1 April 1999 


Yes 















I HEREBY CLAIM the benefit under Title 35, United States Code § 1 1 9(e) of any United 
States provisional application(s) listed below. 



U.S. Provisional Application Number 


Filing Date 















I HEREBY CLAIM the benefit under Title 35, United States Code, §120 of any United 
States application(s), or § 365(c) of any PCT international application designating the United 
States of America, listed below and, insofar as the subject matter of each of the claims of this 
application is not disclosed in the prior United States or PCT International application in the 
manner provided by the first paragraph of Title 35, United States Code, § 112, I acknowledge 
the duty to disclose information which is material to patentability as defined in Title 37, Code of 
Federal Regulations, § 1 .56 which became available between the filing date of the prior 
application and the national or PCT international filing date of this application. 



U.S. Parent 
Application Number 


PCT Parent 
Application Number 


Parent 
Filing Date 


Parent 1 
Patent Number 



























I HEREBY APPOINT the following registered attorneys and agents of the law firm of 
FOLEY & LARDNER to have full power to prosecute this application and any continuations, 
divisions, reissues, and reexaminations thereof, to receive the patent, and to transact all 
business in the United States Patent and Trademark Office connected therewith: 



STEPHEN A. BENT 


Reg. 


No. 


29,768 


DAVID A. BLUMENTHAL 


Reg. 


No. 


26,257 


BETH A. BURROUS 


Reg. 


No. 


35,087 


ALAN 1. CANTOR 


Reg. 


No. 


28,163 


WILLIAM T. ELLIS 


Reg. 


No. 


26,874 


JOHN J. FELDHAUS 


Reg 


No. 


28,822 


PATRICIA D. GRANADOS 


Reg 


No. 


33,683 
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JOHN P. ISACSON 


Reg. 


No. 


33,715 


MICHAEL D. KAMINSKI 


Reg. 


No. 


32,904 


LYLE K. KIM MS 


Reg. 


No. 


34,079 


KENNETH E. KROSIN 


Reg. 


No. 


25,735 


JOHNNY A. KUMAR 


Reg. 


No. 


34,649 


GLENN LAW 


Reg. 


No. 


34,371 


PETER G. MACK 


Reg. 


No. 


26,001 


BRIAN J. MC NAMARA 


Reg. 


No. 


32,789 


SYBIL MELOY 


Reg. 


No. 


22,749 


RICHARD C. PEET 


Reg. 


No. 


35,792 


GEORGE E. QUILLIN 


Reg. 


No. 


32,792 


COLIN G. SANDERCOCK 


Reg. 


No. 


31,298 


BERNHARD D. SAXE 


Reg. 


No. 


28,665 


CHARLES F. SCHILL 


Reg. 


No. 


27,590 


RICHARD L. SCHWAAB 


Reg. 


No. 


25,479 


ARTHUR SCHWARTZ 


Reg. 


No. 


22,115 


HAROLD C. WEGNER 


Reg. 


No. 


25,258 



and I request that all correspondence be directed to: 



Richard L. Schwaab 

FOLEY & LARDNER 

Washington Harbour 

3000 K Street, N.W., Suite 500 

P.O. Box 25696 

Washington, D.C. 20007-8696 

Telephone: (202) 672-5300 
Facsimile: (202) 672-5399 



I UNDERSTAND AND AGREE THAT the foregoing attorneys and agents appointed by me 
to prosecute this application do not personally represent me or my legal interests, but instead 
represent the interests of the legal owner{s) of the invention described in this application. 

I FURTHER DECLARE THAT all statements made herein of my own knowledge are true, 
and that all statements made on information and belief are believed to be true; and further that 
these statements were made with the knowledge that willful false statements and the like so 
made are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the 
United States Code, and that such willful false statements may jeopardize the validity of the 
application or any patent issuing thereon. 



Name of first inventor Naoaki KODAIRA 

Residence Kawasaki-shi, Japan 

Citizenship Japan 



314, Kureare-Toshiba-Miyazakidal, 1-9-12, Miyazaki, 
Post Office Address Miyamae-ku, Kawasaki-shi, Kanagawa-ken, Japan 

Inventor's signature 

Date 
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Name of second inventor 

Residence 

Citizenship 

Post Office Address 

Inventor's signature 

Date 

Name of tliird inventor 

Residence 

Citizenship 

Post Office Address 

inventor's signature 

Date 



Kamal<ura-shi, Japan 
Japan 

1933-2, Yamazaki, Kamakura-shi, Kanagav^ra-ken, Japan 



Hiroki KANNO 
Yokohama-shi, Japan 
Japan 

1-18-1-B602, Kamiookahigashi, Konan-ku, Yokohama-shi, 
Kanagawa-ken, Japan 
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